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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 
All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . |EI This communication is responsive to Request for Continued Examination dated December 23, 2010. 

2. The allowed claim(s) is/are 1-1 1,15-22 and 27 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a) □ All b) □ Some* c) □ None of the: 

1 . □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 
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Paper No./Mail Date . 
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EXAMINER'S STATEMENT OF REASONS FOR ALLOWANCE 
Continued Examination Under 37 CFR 1. 1 14 

A request for continued examination under 37 CFR 1 .1 14 was filed in this 
application after a decision by the Board of Patent Appeals and Interferences, but 
5 before the filing of a Notice of Appeal to the Court of Appeals for the Federal Circuit or 
the commencement of a civil action. Since this application is eligible for continued 
examination under 37 CFR 1.114 and the fee set forth in 37 CFR 1 .17(e) has been 
timely paid, the appeal has been withdrawn pursuant to 37 CFR 1 .1 14 and prosecution 
in this application has been reopened pursuant to 37 CFR 1.114. Applicant's 
1 0 submission filed on December 23, 201 0 has been entered. 

Amendment 

In response to the decision by the Board of Patent Appeals and Interferences, 
dated October 27, 2010, and the Final Rejection, dated November 1 , 2007, claims 1 , 
15 10,17 and 27 have been amended. 

Claims 24-26 were cancelled in the response dated April 30, 2007, and claims 
12-14 and 23 were canceled in the response dated August 17, 2007. 



20 



Allowable Subject Matter 
Claims 1-11, 15-22 and 27 are allowed. 

The following is an examiner's statement of reasons for allowance: 
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Regarding claims 1-9 , the prior art is not found to teach or fairly suggest, an 
imaging apparatus comprising an optical device configured to receive light and to 
provide a plurality of color components of the received light; an image sensor including 
a plurality of color sensor arrays arranged elevationally over one another and configured 
5 to receive respective ones of the color components, and the color sensor arrays 
individually comprising a plurality of sensors configured to provide image data for a 
plurality of pixels of a respective one of the color components at an initial resolution, and 
a processing mechanism, wherein the plurality of color sensor arrays overlap and are 
offset with respect to one another to define a plurality of sub-pixels for individual ones of 

1 0 the pixels, and processing circuitry configured to access the image data for pixels from 
each of the plurality of color sensor arrays, and using the accessed image data, to 
determine sub-pixel image data for the respective sub-pixels to form an image of an 
increased resolution compared with the initial resolution of the color sensor arrays, 
wherein a given pixel of the pixels has a given sub-pixel having a plurality of red 

15 components including a given red component, a plurality of green components including 
a given green component, and a plurality of blue components including a given blue 
component, and wherein the processing mechanism is to generate a blue intensity of 
the given sub-pixel based on a mean of the blue components multiplied by a sum of the 
given red component and the given green component, and divided by a sum of a mean 

20 of the red components and a mean of the green components, a red intensity of the 
given sub-pixel based on a mean of the red components multiplied by a sum of the 
given blue component and the given green component, and divided by a sum of a mean 



Application/Control Number: 10/698,926 Page 4 

Art Unit: 2622 

of the blue components and a mean of the green components, and a green intensity of 
the given sub-pixel based on a mean of the green components multiplied by a sum of 
the given red component and the given blue component, and divided by a sum of a 
mean of the red components and a mean of the blue components. 

5 

Regarding claims 10, 11, 15 and 1 6 , the prior art is not found to teach or fairly 
suggest, an imaging apparatus comprising an image sensing means implemented as a 
single device, and including a plurality of color sensor arrays, individual sensor arrays 
comprising a plurality of sensor means for providing image data for a plurality of pixels 

10 of a respective color component at an initial resolution, wherein individual ones of the 
sensor arrays are arranged elevationally over one another in a layered stack of the 
image sensing means for individually detecting red, green, and blue components of 
light, respectively, wherein the plurality of sensor means of respective color sensor 
arrays are arranged in an offset relationship with respect to one another in the single 

1 5 device for defining a plurality of sub-pixels for individual ones of the pixels, and 

processing means for accessing the image data for at least one pixel from each of the 
plurality of color sensor arrays, and using the accessed image data, to form an image of 
an increased resolution compared with the initial resolution of the color sensor arrays, 
wherein a given pixel of the pixels has a given sub-pixel having a plurality of red 

20 components including a given red component, a plurality of green components including 
a given green component, and a plurality of blue components including a given blue 
component, and wherein the processing means is for generating a blue intensity of the 
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given sub-pixel based on a mean of the blue components multiplied by a sum of the 
given red component and the given green component, and divided by a sum of a mean 
of the red components and a mean of the green components, a red intensity of the 
given sub-pixel based on a mean of the red components multiplied by a sum of the 
5 given blue component and the given green component, and divided by a sum of a mean 
of the blue components and a mean of the green components, and a green intensity of 
the given sub-pixel based on a mean of the green components multiplied by a sum of 
the given red component and the given blue component, and divided by a sum of a 
mean of the red components and a mean of the blue components. 

10 

Regarding claims 17-22 , the prior art is not found to teach or fairly suggest, an 
image data processing method comprising: providing image data using an image 
sensor, and the providing comprising receiving light travelling in a direction using an 
optical device, using the optical device, providing the light into a plurality of light 

1 5 components corresponding to different wavelengths of the light and outputting individual 
ones of the light components in the same direction of travel of the received light, 
receiving the light components using a plurality of color sensor arrays of the image 
sensor, wherein the color sensor arrays have an initial resolution, generating image 
data using the color sensor arrays, and accessing the image data from each of the 

20 plurality of color sensor arrays, and forming an image having an increased resolution 
compared with the initial resolution of the color sensor arrays using the accessed image 
data, wherein a given pixel of the image data has a given sub-pixel having a plurality of 
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red components including a given red component, a plurality of green components 
including a given green component, and a plurality of blue components including a 
given blue component, and wherein forming the image comprises generating a blue 
intensity of the given sub-pixel based on a mean of the blue components multiplied by a 
5 sum of the given red component and the given green component, and divided by a sum 
of a mean of the red components and a mean of the green components, a red intensity 
of the given sub-pixel based on a mean of the red components multiplied by a sum of 
the given blue component and the given green component, and divided by a sum of a 
mean of the blue components and a mean of the green components, and a green 
10 intensity of the given sub-pixel based on a mean of the green components multiplied by 
a sum of the given red component and the given blue component, and divided by a sum 
of a mean of the red components and a mean of the blue components. 



Regarding claim 27 , the prior art is not found to teach or fairly suggest, an article 
15 of manufacture comprising a processor-usable medium comprising processor-usable 
code configured to cause processing circuitry to perform processing comprising 
accessing image data for at least one pixel from each of a plurality of color sensor 
arrays at an initial resolution, and forming an image of increased resolution, compared 
with the initial resolution of individual ones of the color sensor arrays, using the 
20 accessed image data, wherein the color sensor arrays are offset with respect to one 
another providing a plurality of image data values for at least one color component for a 
single pixel location and wherein a sum of the image data values comprising intensity 
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values for a single color component for the single pixel location are equal to an intensity 
value of the accessed image data for the single color component for the single pixel 
location, wherein a given pixel of the image data has a given sub-pixel having a plurality 
of red components including a given red component, a plurality of green components 
5 including a given green component, and a plurality of blue components including a 
given blue component, and wherein forming the image comprises generating a blue 
intensity of the given sub-pixel based on a mean of the blue components multiplied by a 
sum of the given red component and the given green component, and divided by a sum 
of a mean of the red components and a mean of the green components, a red intensity 

1 0 of the given sub-pixel based on a mean of the red components multiplied by a sum of 
the given blue component and the given green component, and divided by a sum of a 
mean of the blue components and a mean of the green components, and a green 
intensity of the given sub-pixel based on a mean of the green components multiplied by 
a sum of the given red component and the given blue component, and divided by a sum 

15 of a mean of the red components and a mean of the blue components. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
20 Statement of Reasons for Allowance." 
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Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

U.S. Patent No. 3,717,724 to Montgomery teaches a solid state image sensor in 
5 a stacked layer arrangement based on the wavelength absorption of a given color. 

U.S. Patent No. 5,965,875 to Merrill teaches a solid state image sensor with a 
triple-well configuration. 

U.S. Patent No. 6,429,953 to Feng teaches a solid state image sensor with an 
overlapping and offset arrangement. 
10 U.S. Patent Publication No. 2004/0178465 to Merrill teaches a vertically stacked, 

multi-color, solid state image sensor. 

U.S. Patent No. 7,51 1 ,866 to Feng teaches a solid state image sensor with an 
overlapping and offset arrangement. 



1 5 Contact 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gary C. Vieaux whose telephone number is (571)272- 
7318. The examiner can normally be reached on IFW. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
20 supervisor, Jason Chan can be reached on 571-272-3022. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
5 For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Gcv2 

/Jason Chan/ 

Supervisory Patent Examiner, Art Unit 2622 



